Moderators: FourthWorld, heatherlaine, Klaus, kevinmiller
Code: Select all
/*
*** Formatting HTML code ***
indentHtml v.0.1.0, 13 June 2011
Adjust kTags to define tags that need indentation.
Parameters:
theHtml: any valid HTML source code;
theTabSpaces: the number of positions occupied by one tab character
theSoftWrapCol: the column (=position number) after which lines are wrapped
theReplaceTabs: replace tabs with spaces (true, false)
theDontBreakLinks: treat links as regular text, don't indent.
If you change kTags, you should be able to format any mark-up language as
long as it uses < and > to define tags.
By Mark Schonewille
Economy-x-Talk
Nijmegen, the Netherlands
http://economy-x-talk.com
For questions and comments, use the contact form on the website
*/
constant kTags = "html,body,head,title,a,b,i,font,h1,h2,h3,h4,h5,div,center,table,tr,td,th,form,select"
local myTagArray
function indentHtml theHtml,theTabSpaces,theSoftWrapCol,theReplaceTabs,theDontBreakLinks
replace cr with empty in theHtml
put 0 into myOldOffset
put 0 into myPreviousOldOffset
put 0 into myLevel
put empty into myTabs
repeat
put offset("<",theHtml,myOldOffset) into myNewOffset -- open tag
if myNewOffset is 0 then exit repeat else add myOldOffset to myNewOffset
put offset(">",theHtml,myNewOffset) into myOldOffset -- close tag
if myOldOffset is 0 then exit repeat else add myNewOffset to myOldOffset
put word 1 of (char myNewOffset+1 to myOldOffset-1 of theHtml) into myTag
put ((myTag is "a" or myTag is "/a") and theDontBreakLinks is true) into myCurrentTagIsLink
///if myTag is "/a" then breakpoint
put char myPreviousOldOffset+1 to myNewOffset-1 of theHtml into myData
if myData is not empty then
put theSoftWrapCol - theTabSpaces*(number of chars of myTabs+1) into myTempWrapCol
put 1 into myLineCounter
if myCurrentTagIsLink or (myPreviousTag is "/a" and theDontBreakLinks is true) then
// put offset("<",myData) into myTagPosition
repeat
if number of chars of line myLineCounter of myData > myTempWrapCol and "<" is not in \
char 1 to myTempWrapCol of line myLineCounter of myData then
put cr & myTabs before word (number of words of (char 1 to myTempWrapCol of line \
myLineCounter of myData) + 1) of line myLineCounter of myData
add 1 to myLineCounter
else
exit repeat
end if
end repeat
if myTag is not "/a" and myPreviousTag is not "/a" then
put myTabs before line 1 of myData
end if
else if theTabSpaces is a number and theTabSpaces > 0 and theSoftWrapCol is a number and \
theSoftWrapCol > 0 then
repeat
if number of chars of line myLineCounter of myData > myTempWrapCol then
put cr before word (number of words of (char 1 to myTempWrapCol of line \
myLineCounter of myData) + 1) of line myLineCounter of myData
add 1 to myLineCounter
else
exit repeat
end if
put myTabs before line myLineCounter-1 of myData
end repeat
if last char of myData is cr then delete last char of myData
put myTabs before the last line of myData
end if
if myCurrentTagIsLink then
put myData after myNewData
else
put myData & cr after myNewData
end if
end if
if (char 1 of myTag is slash and char 2 to -1 of myTag is among the items of kTags) then
subtract 1 from myLevel
put empty into myTabs
repeat myLevel
put tab after myTabs
end repeat
end if
if myLevel < 0 then put 0 into myLevel
if myCurrentTagIsLink then
put char myNewOffset to myOldOffset of theHtml after myNewData
else
put myTabs & char myNewOffset to myOldOffset of theHtml & cr after myNewData
end if
put myOldOffset into myPreviousOldOffset
// if opening tag then after
if myTag is among the items of kTags then
add 1 to myLevel
put empty into myTabs
repeat myLevel
put tab after myTabs
end repeat
end if
put myTag into myPreviousTag
end repeat
put myTabs & char myOldOffset+1 to -1 of theHtml after myNewData
if theTabSpaces is a number and theTabSpaces > 0 and theReplaceTabs is true then
put empty into mySpaces
repeat theTabSpaces
put space after mySpaces
end repeat
replace tab with mySpaces in myNewData
end if
return myNewData
end indentHtml
On Jun 12, 2011, pmbrig wrote: One technique is to replace a repeating string that sets off pieces of content you want to isolate with a single character, e.g.,
replace "<td valign="top" align=center>" with divChar in tText
then use that as an itemdelim or linedelim to access "item n of tText" or "line n of tText"
You need to make sure that the characters you will use as delimiters are not found in the text. For HTML, all you have to do is use any higher-ASCII characters. Here is a way of doing that that actually works also with text that may contain high-ASCII characters, but you can use this fine to parse HTML text.
Code: Select all
local lineChar, itemChar, cellDivChar
local textBlockDivider, frameDivider -- extras as needed
on assignDelims tText
put getdelimiters(tText) into delimArray
-- an array of high-ASCII characters not found in tText
put "lineChar,itemChar, cellDivChar" into delimList
-- add more if you want, these are
put the number of items of delimList into nbrDelimsNeeded
repeat with i = 1 to nbrDelimsNeeded
put delimArray[i] into tDelim
if tDelim = empty then
answer "Could only assign" && i-1 && "out of" && \
nbrDelimsNeeded & "!"
-- in case you have high nbrDelimsNeeded
-- or tText contains lots of unusual characters,
-- and the list of allowable delims is very short
exit to top
end if
do "put tDelim into" && item i of delimList
end repeat
-- you can also do this manually, for one-off parsing jobs
-- should check that delimArray[n] is not empty if in doubt
-- (declare script local variables as needed)
-- put delimArray[4] into textBlockDivider
-- put delimArray[5] into frameDivider
-- etc
end assignDelims
on getdelimiters tText
if tText = empty then return empty
put "ßπ∆ƒµ¡™£¢∞§¶ªç≈…æ∑ø©®Ω" into charList
-- don't know if this will show well in all email clients
-- it's a string of high-ASCII characters
put 0 into tCount
repeat for each char tChar in charList
if tChar is in tText then next repeat
add 1 to tCount
put tChar into delimList[tCount]
end repeat
return delimList
end getdelimiters
-- Then you can do things like:
replace cr with empty in tText
-- html ignores cr's, and extraneous returns may complicate things
replace "<p>" with lineChar in tText
replace "</font></td><td valign="top"><font face="Arial" size="-1">" with cellDivChar in tText
-- or whatever the tag string is for this particular table
-- then:
set the lineDelimiter to lineChar
set the itemDelimiter to cellDivChar
repeat for each line tLine in tText
repeat for each item textRun in tLine
-- do more parsing stuff here:
-- now you can work on each block textRun
end repeat
end repeat
/*
This helps to pare down some of the HTML formatting/tagging so as to use LC's powerful chunk manipulation to extract the content you want.
-- Peter
*/
Already being nuts myself, I don't mind the mental torture, but I hope Mariasole understands if I don't spend quite *that* much time on itFourthWorld wrote: ↑Sat Mar 17, 2018 7:41 pmIf you attempt to write a single routine which can extract an "article" from any web page, you will go insane and as you eek out your remaining existence in an asylum you will never find a satisfying solution to your dying day.
). I really thank you for your help.
, given that, set aside for now boilerpipe because Java remains a mystery for us artists of Hypercard , but remains a hope in Javascript, I think much more affordable!
, could you interface the some way? ) . 
. If I could interface this library with the browser widget, due to subtraction of function in the javascript code library, I would be able to understand how it works and make a porting on Livecode (obviously in a couple of years!To parse a document, you must create a new `Readability` object from a URI object and a document object, and then call `parse()`. Here's an example:
```javascript
var loc = document.location;
var uri = {
spec: loc.href,
host: loc.host,
prePath: loc.protocol + "//" + loc.host,
scheme: loc.protocol.substr(0, loc.protocol.indexOf(":")),
pathBase: loc.protocol + "//" + loc.host + loc.pathname.substr(0, loc.pathname.lastIndexOf("/") + 1)
};
var article = new Readability(uri, document).parse();
```
This `article` object will contain the following properties:
* `uri`: original `uri` object that was passed to constructor
* `title`: article title
* `content`: HTML string of processed article content
* `length`: length of article, in characters
* `excerpt`: article description, or short excerpt from content
* `byline`: author metadata
* `dir`: content direction
If you're using Readability on the web, you will likely be able to use a `document` reference from elsewhere (e.g. fetched via XMLHttpRequest, in a same-origin `<iframe>` you have access to, etc.). Otherwise, you would need to construct such an object using a DOM parser such as [jsdom](https://github.com/tmpvar/jsdom). While this repository contains a parser of its own (`JSDOMParser`), that is restricted to reading XML-compatible markup and therefore we do not recommend it for general use.
) I'll leave professering to Richmond 
), I consider porting in other languages as a sort of Rosetta Stone. Hmmm, maybe it *can* be done now. While I was browsing through Max's wiki, I came across this in reference to the Foreign Function Interface built into Lc9. I didn't understand it all mind you.Mariasole wrote: ↑Tue Mar 13, 2018 10:09 amI read the article: https://livecode.com/infinite-livecode-java-progress/
I do not understand anything about Java ... but I think that what I ask can not be done!
Mariasole
(='.'=)